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1 Introduction 

Turkish, like Finnish, German, Hindi, Japanese, and 
Korean, has considerably freer word order than En- 
glish. In these languages, word order variation is used 
to convey distinctions in meaning that are not gener- 
ally captured in the semantic representations that have 
been developed for English, although these distinctions 
are also present in somewhat less obvious ways in En- 
glish. In the next section, I present a summary of the 
linguistic data on Turkish word order variations. Sec- 
tion 3 describes the categorial formalism I propose to 
model the syntax, semantics, and pragmatic informa- 
tion in Turkish sentences. To capture the syntax of 
free word order languages, I present an adaptation of 
Combinatory Categorial Grammars, CCGs (Steedman- 
85; Steedman-91), called {}-CCGs (set-CCGs). Then, 
I integrate a level of information structure, represent- 
ing pragmatic functions such as topic and focus, with 
{}-CCGs to allow pragmatic distinctions in meaning to 
influence the word order of the sentence in a composi- 
tional way. In Section 4, I discuss how this strategy is 
used within a generation system which produces Turk- 
ish sentences with word orders appropriate to the con- 
text, and include sample runs of the implementation. 



2 Free Word Order in Turkish 

The most common word order used in simple transitive 
sentences in Turkish is SOV (Subject-Object- Verb), but 
all six permutations of a transitive sentence can be used 
in the proper discourse situation since the subject and 
object are differentiated by case-marking.^ 
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According to a language acquisition study in (Slobin-82), 52% 
of transitive sentences used by a sample of Turkish speakers were 
not in the canonical SOV word order. 



(1) a. Ayse Fatma'yi ariyor. 

Ayse Fatma-Acc seek-Pres-(3Sg). 
"Ayse is looking for Fatma." 

b. Fatma'yi Ayse ariyor. 

c. Ayse ariyor Fatma'yi. 

d. Fatma'yi ariyor Ayse. 

e. Ariyor Fatma'yi Ayse. 

f. Ariyor Ayse Fatma'yi. 

The propositional interpretation assigned to all six 
of these sentences is seek'(Ay§e', Fatma'). However, 
each word order conveys a different discourse meaning 
only appropriate to a specific discourse situation. The 
one propositional interpretation cannot capture the dis- 
tinctions in meaning necessary for effective translation 
and communication in Turkish. The interpretations 
of these different word orders rely on discourse-related 
notions such as theme/rheme, focus/presupposttton, 
topic/ comment, etc. that describe how the sentence 
relates to its context. 

There is little agreement on how to represent the 
discourse-related functions of components in the sen- 
tence, i.e. the information structure of the sentence. 
Among Turkish linguists, Erguvanli (Erguvanli-84) cap- 
tures the general use of word order by associating each 
position in a Turkish sentence with a specific pragmatic 
function. Generally in Turkish, speakers first place the 
information that links the sentence to the previous con- 
text, then the important and/or new information im- 
mediately before the verb, and the information that is 
not really needed but may help the hearer understand 
the sentence better, after the verb. Erguvanli identifies 
the sentence-initial position as the topic, the immedi- 
ately preverbal position as the focus, and the postver- 
bal positions as backgrounded information. The follow- 
ing template that I will be using in the implementation 
describes the general association between sentence po- 
sitions and information structure components (in bold 
font) for Turkish: 

(2) Topic Neutral Focus Verb Background 



I will call the phrase formed by the topic and the neutral 
components the theme of the sentence and the phrase 
formed by the focus and the verb, the rheme of the 
sentence. 

Using these information structure components, we 
can now explain why certain word orders are appro- 
priate or inappropriate in a certain context. For exam- 
ple, a speaker may use the SOV order in (3b) because in 
that context, the speaker wants to focus the new object, 
Ahmet, and so places it in the immediately preverbal 
position. However, in (4)b, Ahmet is the topic or a link 
to the previous context whereas the subject, Fatma, is 
the focus, and thus the OSV word order is used. Here, 
we translate these Turkish sentences to English using 
different "stylistic" constructions (e.g. topicalization, 
it-clefts, phonological focusing etc.) in order to pre- 
serve approximately the same meanings. 

(3) a. Fatma kimi ariyor? 

Fatma who seek-Pres? 
"Who is Fatma looking for?" 
b. Fatma Ahmet'i ariyor. SOV 

Fatma Ahmet-Acc seek-Pres. 
"Fatma is looking for AHMET." 

(4) a. Ahmet'i kim ariyor? 

Ahmet-Dat who seek-Pres. 
"Who is looking for Ahmet?" 
b. 

Ahmet'i Fatma ariyor. OSV 

Ahmet-Acc Fatma seek-Pres. 

"As for Ahmet, it is FATMA who is looking for him." 

It is very common for Turkish speakers to put 
information already mentioned in the discourse, i.e. 
discourse-given, in the post-verbal positions, in the 
background component of the information structure. 
In fact, discourse-new elements cannot occur in the 
postverbal positions. In addition, referential status, i.e. 
whether the speaker uses a full noun phrase, an overt 
pronoun, or a null pronoun to refer to an entity in the 
discourse, can be used to signal the familiarity infor- 
mation to the hearer. Thus, given information can be 
freely dropped (5)bi or placed in post-verbal positions 
(5)b2 in Turkish. Although further research is required 
on the interaction between referential status and word 
order, I will not concentrate on this issue in this pa- 
per. 

(5) a. Fatma Ahmet'i aradi. 

Fatma Ahmet-Acc seek-Past. 
"Fatma looked for Ahmet." 
bi. Ama bulamadi. 

But find-Neg-Past. 

"But (she) could not find (him)." 



b2. Ama bulamadi Fatma Ahmet'i. 

But find-Neg-Past Fatma Ahmet-Acc. 

"But she, Fatma, could not find him, Ahmet." 
The same information structure components topic, 
focus, background can also explain the positioning of 
adjuncts in Turkish sentences. For example, placing a 
locative phrase in different positions in a sentence re- 
sults in different discourse meanings, much as in English 
sentences: 
(6) a. Fatma Ahmet'i Istanbul'da aradi. 

Fatma Ahmet-Acc Istanbul-loc seek-Past. 

"Fatma looked for Ahmet in ISTANBUL." 

b. Istanbul'da Fatma Ahmet'i aradi. 
Istanbul-loc Fatma Ahmet-Acc seek-Past. 
"In Istanbul, Fatma looked for Ahmet." 

c. Fatma Ahmet'i aradi Istanbul'da. 
Fatma Ahmet-Acc seek-Past Istanbul-loc. 
"Fatma looked for Ahmet, in Istanbul." 

Long distance scrambling, word order permutation in- 
volving more than one clause, is also possible out of 
most embedded clauses in Turkish; in complex sen- 
tences, elements of the embedded clauses can occur 
in matrix clause positions. However, these word or- 
ders with long distance dependencies are only used by 
speakers for specific pragmatic functions. Generally, an 
element from the embedded clause can occur in the sen- 
tence initial topic position of the matrix clause, as in 
(7)b, or to the right of the matrix verb as backgrounded 
information, as in (7)c.^ 

(^) ^- 

Fatma [Ayse'nin gittigini] biliyor. 

Fatma [Ayse-Gen go-Ger-3sg-Acc] know-Prog. 

"Fatma knows that Ayse left." 
b. 

Ayse'niuj- Fatma [ti gittigini] biliyor. 

Ayse-GeUj- Fatma [ti go-Ger-3sg-Acc] know-Prog 

"As for Ayse, Fatma knows that she left." 
c. 

Fatma [ti gittigini] biliyor Ayse'nin,-. 

Fatma [ti go-Ger-3sg-Acc] know-Prog Ayse-Gen,- 

"Fatma knows that she, Ayse, left." 

3 The Categorial Formalism 

Many different syntactic theories have been proposed to 
deal with free word order variation. It has been widely 
debated whether word order variation is the result of 
stylistic rules, the result of syntactic movement, or base- 
generated. I adopt a categorial framework in which 
the word order variations in Turkish are pragmatically- 



I have put in coindexed traces and italicized the scrambled 
elements in these examples to help the reader; I am not making 
the syntactic claim that these traces actually exist. 



driven; this lexicalist framework is not compatible with 
transformational movement rules. 

My work is influenced by (Steedman-91) in which 
a theory of prosody, closely related to a theory of 
information structure, is integrated with Combina- 
tory Categorial Grammars (CCGs). Often intona- 
tional phrase boundaries do not correspond to tradi- 
tional phrase structure boundaries. However, by us- 
ing the CCG type-raising and composition rules, CCG 
formalisms can produce nontraditional syntactic con- 
stituents which may match the intonational phrasing. 
These intonational phrases often correspond to a unit 
of planning or presentation with a single discourse func- 
tion, much like the information structure components 
of topic, neutral, focus, and background in Turkish sen- 
tences. Thus, the ambiguity that CCG rules produce is 
not spurious, but in fact, necessary to capture prosodic 
and pragmatic phrasing. The surface structure of a sen- 
tence in CCGs can directly reflect its information struc- 
ture, so that different derivations of the same sentence 
correspond to different information structures. 

In the previous section, we saw that ordering of con- 
stituents in Turkish sentences is dependent on prag- 
matic functions, the information structure of the sen- 
tence, rather than on the argument structure of the sen- 
tence as in English. Moreover, information structure is 
distinct from argument structure in that adjuncts and 
elements from embedded clauses can serve a pragmatic 
function in the matrix sentence and thus be a compo- 
nent of the information structure without taking part 
in the argument structure of the matrix sentence. This 
suggests an approach where the ordering information 
which is dependent on the information structure is sep- 
arated from the the argument structure of the sentence. 
In section 3.1, I describe a version of CCGs adapted for 
free word order languages in (IIoffman-92) to capture 
the argument structure of Turkish, while producing a 
flexible surface structure and word order. In addition, 
each CCG constituent is associated with a pragmatic 
counterpart, described in section 3.2, that contains the 
context-dependent word order restrictions. 

3.1 {}-CCG 

Multi-set Combinatory Categorial Grammars, 
{}-CCGs, (IIoffman-92) is a version of CCGs for free 
word order languages in which the subcategorization 
information associated with each verb does not spec- 
ify the order of the arguments. Each verb is assigned a 
function category in the lexicon which specifies a multi- 
set of arguments, so that it can combine with its argu- 
ments in any order. For instance, a transitive verb has 
the following category S\{Nn, Na} which defines a 
function looking for a set of arguments, nominative case 



noun phrase (Nn) and an accusative case noun phrase 
(Na), and resulting in the category S, a complete sen- 
tence, once it has found these arguments. Some phrase 
structure information is lost by representing a verb as 
a function with a set of arguments. However, this cat- 
egory is also associated with a semantic interpretation. 
For instance, the verb "see" could have the following 
category where the hierarchical information among the 
arguments is expressed within the semantic interpre- 
tation separated from the syntactic representation by 
a colon: S : see(X,Y)\{Nn : X,Na : Y}. This 
category can easily be transformed into a DAG repre- 
sentation like the following where coindices,a; and y, are 
indicated by italicized font.^ 



(8) 



Result 



Syn : [Cat: S, Tense: Pres] 
Sem : see(x,y) 



Args 



Syn : 


Cat 
Case 


np 
nom 


Sem : x 






Syn : 


'Cat 
Case 


np 

ace 


Sem : y 







We can modify the CCG application rules for func- 
tions with sets as follows. The sets indicated by braces 
in these rules are order-free, i.e. Y in the following rules 
can be any element in the set. Functions can specify 
a direction feature for each of their arguments, notated 
in the rules as an arrow above the argument.'* We as- 
sume that a category Xjl } where { } is the empty set 
rewrites by a clean-up rule to just X. 

(9) a. Forward Application' (>): 

X\{Y,...} Y => X\{...} 
b. Backward Application' (<): 

Y X\{Y,...} => X\{...} 

Using these new rules, a verb can apply to its arguments 
in any order. For example, the following is a derivation 
of a sentence with the word order 
Object-Subject- Verb^ : 



■^To improve the efficiency of unification and parsing, the ar- 
guments in the set can be associated with feature labels which 
indicate their category and case. 

Since Turkish is not strictly verb-final, most verbs will not 
specify the direction features of their arguments. 

Since I adopt a bottom- up generation algorithm, these deriva- 
tions are used in both the parsing and the generation of Turkish 
sentences. 



(10) Gazeteyi Ayse 

Newspaper-acc Ayse 
Na Nn 



okuyor. 

reads. 

5'|{Nn,Na} 



-< 



S'lJNa} 
< 



Instead of using the set notation, we could imag- 
ine assigning Turkish verbs multiple lexical entries, one 
for each possible word order permutation; for exam- 
ple, a transitive verb could be assigned the categories 
S\Nn\Na, S\Na\Nn, S\Na/Nn, etc., instead of the 
one entry S\{Nn, Na}. However, we will see below that 
the set notation is more than a shorthand represent- 
ing multiple entries because it allows us to handle long 
distance scrambling, permutations involving more than 
one clause, as well. 

The following composition rules are proposed to com- 
bine two functions with set-valued arguments, e.g. two 
verbs. 
(11) a. Forward Composition' (> B): 

X\{Y,...i} Y|{...2} _^X|{...i,...2} 
b. Backward Composition' (< B): 

Y|{...i} X\{Y,...2} ^X\{.. .,,...,} 
These composition rules allow two verb categories with 
sets of arguments to combine together. For example, 
(12) 

go-gerund-acc knows. 

SNa ■ go(y)\{Ng : y} S : know(x,p) |{Nn: x, S„a: p} 

<B 

S : know(x, go(y))\{Ng : y,Nn : x} 

As the two verbs combine, their arguments collapse into 
one argument set in the syntactic representation. How- 
ever, the verbs' respective arguments are still distinct 
within the semantic representation of the sentence. The 
predicate-argument structure of the subordinate clause 
is embedded into the semantic representation of the 
matrix clause. Long distance scrambling can easily be 
handled by first composing the verbs together to form 
a complex verbal function which can then apply to all 
of the arguments in any order. 

Certain coordination constructions (such as 'SO and 
SOV seen in (13) as well as 'SOV and SO') can be han- 
dled in a CCG based formalism by type-raising NPs into 
functions over verbs. Two type-raised noun phrases 
can combine together using the composition rules to 
form a nontraditional constituent which can then coor- 
dinate. 
(13) 

Ayse kitabi, Fatma da gazeteyi okuyor. 

Ayse book-acc, Fatma too newspaper-acc reads. 

"Ayse is reading the book and Fatma the newspaper." 



Order-preserving type-raising rules that are modified 
for {}-CCGs are used to convert nouns in the gram- 
mar into functors over the verbs. These rules can be 
obligatorily activated in the lexicon when case-marking 
morphemes attach to the noun stems. 



(14) a. N -F case => {S\{...}) \ {S'UNcase, ... }} 



b. N -F case => (S'|{...}) | {S |{Ncase, ...}} 
The first rule indicates that a noun in the presence of 
a case morpheme becomes a functor looking for a verb 
on its right; this verb is also a functor looking for the 
original noun with the appropriate case on its left. After 
the noun functor combines with the appropriate verb, 
the result is a functor which is looking for the remaining 
arguments of the verb. The notation ... is a variable 
which can unify with one or more elements of a set. 

The second type-raising rule indicates that a case- 
marked noun is looking for a verb on its left. {}-CCGs 
can model a strictly verb-final language like Korean by 
restricting the noun phrases of that language to the 
first type-raising rule. Since most, but not all, case- 
marked nouns in Turkish can occur behind the verb, 
certain pragmatic and semantic properties of a Turkish 
noun determine whether it can type-raise to the cate- 
gory produced by the second rule. 

The {}-CCG for Turkish described above can be used 
to parse and generate all word orders in Turkish sen- 
tences. However, it does not capture the more interest- 
ing questions about word order variation: namely, why 
speakers choose a certain word order in a certain con- 
text and what additional meaning these different word 
orders provide to the hearer. Thus, we need to inte- 
grate the {}-CCG formalism with a level of information 
structure that represents pragmatic functions, such as 
topic and focus, of constituents in the sentence in a 
compositional way. 

3.2 A Grammar for Word Order 

In (Steedman-91; Prevost/Steedman-93), a theory of 
prosody, closely related to a theory of information struc- 
ture, is integrated with CCGs by associating every CCG 
category encoding syntactic and semantic properties 
with a prosodic category. Taking advantage of the non- 
traditional constituents that CCGs can produce, two 
CCG constituents are allowed to combine only if their 
prosodic counterparts can also combine. 

Similarly, I adopt a simple interface between {}-CCG 
and ordering information by associating each syntac- 
tic/semantic category with an ordering category which 
bears linear precedence information. These two cat- 
egories are linked together by the features of the in- 
formation structure. For example, the verb "ariyor" 



ariyor (seek) 



Category 



Result 



Args 



Syn : 
Sem : 

Info : / 

Syn : 
Sem : 



Cat : S 
Tense : Pres 



Event : 
LF : 

Theme 



[seek(x,y), Xlf,Ylf] 

Topic : T 
Neutral : N 



Rheme 
Background : B 

Cat : np 
Case : nom 

Entity : x 
Props : Xlf 



Focus : F 

Main-Prop : seek 



Syn 
Sem 



Cat 



np 



Case : ace 

Entity : y 
Props : Ylf 



Order : //([Background : 5])\([Topic : T])\([Neutral : #])\([Focus : F]) 

Figure 1: The Lexical Entry for a Transitive Verb, "ariyor" (seeks). 



(seeks) is assigned the lexical entry seen in the category 
feature of the DAG in Figure 1. The category feature 
contains the argument structure in the features syn and 
sem as well as the information structure in the feature 
mfo. This lexical entry is associated with an ordering 
category seen in the feature order of the DAG in Fig- 
ure 1. This ordering feature is linked to the category 
feature via the co-indices T, N, F, and B. 

The ordering categories are assigned to lexical entries 
according to context-dependent word order restrictions 
found in the language. All Turkish verbs are assigned 
the ordering category seen in the order feature in Fig- 
ure 1; this is a function which can use the categorial 
application rules to first combine with a focused con- 
stituent on its left, then a neutral constituent on its left, 
then a topic constituent on its left, and then a back- 
ground constituent on its right, finally resulting in a 
complete utterance. This function represents the tem- 
plate mentioned in example 2 for assigning discourse 
functions according to their positional relation to the 
verb following (Erguvanli-84). However, it is more fiex- 
ible than Erguvanli's approach in that it allows more 
than one possible information structure. The parenthe- 
ses around the arguments of the ordering category in- 
dicate that they are optional arguments. The sentence 
may contain all or some or none of these information 
structure components.® It may turn out that we need 



This is similar to Vallduvi's approach (Vallduvi-90) for Cata- 
lan in which there are three components, link (to the previous 
context), focus, and tail, where the link and tail can be optional. 
One difference is that Vallduvi allows the verb to be a part of any 
component, but it is not clear how this could be implemented. 



to restrict the optionality on these components. For in- 
stance, if there is no topic found in the sentence-initial 
position, then we may need to infer a topic or a link to 
the previous context. In the current implementation, 
the focus is an obligatory constituent in order to ensure 
that the parser produces the derivation with the most 
likely information structure first, and there is an addi- 
tional ordering category possible where the verb itself 
is focused and where there are no pre-verbal elements 
in the sentence. 

Categories other than verbs, such as nouns, deter- 
miners, adjectives, and adverbs, are associated with an 
ordering category that is just a basic element, not a 
function. In Turkish, the familiarity status of entities 
in the discourse model serves a role in determining their 
discourse function. For example, discourse-new entities 
cannot occur in the post-verbal or sentence initial po- 
sitions in Turkish sentences. Thus, discourse-new el- 
ements can be assigned ordering categories with the 
feature-attribute focus or neutral with their semantic 
properties as the feature- value, but they cannot be as- 
sociated with background or topic ordering categories. 
There are no such restrictions for discourse-old entities; 
thus they can be assigned a variable which can unify 
with any of the information structure components. 

During a derivation in parsing or generation, two con- 
stituents can combine only if the categories in their 
category features can combine using the {}-CCG rules 
presented in the previous section, and the categories 
in their order features can combine using the follow- 
ing rewriting rules. A sample derivation involving the 
ordering grammar can be seen in Figure 2. 



Q: Ayse Fatma'yi ne zaman aradi? 
Ayse Fatma-Acc when call-Past? 

"When did Ayse call Fatma?" 

A: Bugiin aradi 

Today call-Past 

Focus-.today' //(Bkgd:_B)\(Topic: T)\(Neutral:#)\(Focus:_F) 

(<) 

//(Bkgd:5)\(Topic:T)\(Neutral:#) 

//(Bkgd:5)\(Topic:T) 



Ayse 
Ayse 
\:[ayse] 



Fatma'yi. 

Fatma-Acc. 

X:[fatma] 



//(Bkgd:5) 
/ 



['^skipj 



\:[ayse'Jaima] 



-(>) 



-(=) 



Figure 2: A Derivation involving just the Ordering Categories. 



(15) a. Forward Application (>): 

X/Y Y => X where Y is not a functor. 

b. Backward Application (<): 

Y X\Y => X where Y is not a functor. 

c. Forward Skip- Optional Rule {>skip)'- 
X/(Y) Z ^X Z 

d. Backward Skip-Optional Rule {<skip)'- 
Z X\(Y) ^X Z 

e. Identity (=): 
X X ^X 

The identity rule allows two constituents with the 
same discourse function to combine. The resulting 
constituent may not be a traditional syntactic con- 
stituent, however as argued in (Steedman-91), this is 
where we see the advantage of using a CCG based for- 
malism. Through type-raising and composition, CCG 
formalisms can produce nontraditional syntactic con- 
stituents which may have a single discourse function. 
For example in Figure 2, the NPs Fatma and Ay§e 
form a pragmatic constituent using the identity rule 
in the ordering grammar; in order to form a syntac- 
tic constituent as well, they must be type-raised and 
combine together using the {}-CCG composition rule. 
Type-raising in Turkish is needed for sentences involv- 
ing more than one NP in the neutral and background 
positions. 

The ordering grammar also allows adjuncts and ele- 
ments from other clauses (long distance scrambled) to 
be components in the information structure. This is 
because the information structure in a verb's lexical 
entry does not specify that its components must be ar- 
guments of the verb in its argument structure. Thus, 
adjuncts and elements from embedded clauses can be 
serve a purpose in the information structure of the ma- 



trix clause, although they are not subcategorized argu- 
ments of the matrix verb. For long distance scrambling, 
the additional restriction (that Y is not a functor) on 
the application rules given above ensures that a verb in 
the embedded clause has already combined with all of 
its obligatory arguments or skipped all of its optional 
arguments before combining with the matrix verb. 

The ordering grammar presented above is similar 
to the template grammars in (Danlos-87), the syntax 
specialists in PAULINE (Hovy-88), and the realiza- 
tion classes in MUMBLE (McDonald/Pustejovsky-85) 
in that it allows certain pragmatic distinctions to in- 
fluence the syntactic construction of the sentence. The 
ordering grammar does not make as fine-grained prag- 
matic distinctions as the generation systems above, but 
it represents language-specific and context-dependent 
word order restrictions that can be lexicalized into com- 
positional categories. The categorial formalism pre- 
sented above captures the general discourse meaning 
of word order variation in languages such as Turkish 
while using a compositional method. 

4 The Implementation 

I have implemented a simple data-base query task, dia- 
gramed in Figure 3, to demonstrate how the categorial 
formalism presented in the previous section can gener- 
ate Turkish sentences with word orders appropriate to 
the context. The system simulates a Personal Assistant 
who schedules meetings and phone calls with a number 
of individuals. The user issues queries to which the 
program responds, after consulting the data-base, in 
sentences with the appropriate word order, while main- 
taining a model of the changing context. 




Grammar 



DataBase 



Planner 



Lexicon 



Ordering 
Categories 



Tactical 
Generator 



Answer 
Figure 3: The Personal Assistant Generation System 



Discourse 
Model 



Since most of the information is lexicalized, the same 
grammar and lexicon is used by the parser and the 
generator. After the question is parsed, the discourse 
model is updated^, and the question's representation is 
sent to the planning component of the generator. The 
planner at this point consists of simple plans for con- 
structing answers to certain wh-questions and yes/no 
questions. Certain predicates in the queries trigger the 
planner to look up schedules and make appointments 
for the agents mentioned in the query. 

The planner creates a representation for the answer 
by copying much of the question representation and by 
adding the appropriate new information found in the 
database. The information structure of the question 
can be used by the planner as well. The topic of the 
question is copied to the answer in order to maintain 
topic continuity, although in a less limited domain, a 
separate algorithm is needed to allow for shifts in topic. 
In addition, when a yes/no question is not validated 
in the data-base, the planner replaces the focus of the 
question with a variable and requests another search of 
the data-base to find a new focus which statisfies the 
rest of the question. For example,® 



As suggested by (Vallduvi-90), the information structure of 
a sentence can provide cues on how to update and organize the 
discourse model. 

^Particles such as "yes" and "no" are are produced by a sep- 
arate call to the generator, before generating the answer. 



(16) a. Ahmet Fatma'yi gordii mii? 

Ahmet Fatma-Acc see-Past Quest? 
"Did Ahmet see FATMA?" 
b. Hayir, ama Ahmet Ayse'yi gordii. 
No, but Ahmet Ayse-Acc see-Past. 
"No, but Ahmet saw AY§E. 

In all question types, the information found in the 
database lookup is specified to be the focus of the an- 
swer. The semantic properties of the focused entity are 
either found in the database, or if it has already been 
mentioned in the discourse, by consulting the discourse 
model. The planner then passes the representation of 
the answer to the realization component of the genera- 
tor described in the next section. 



4.1 Head-driven Bottom-up Genera- 
tion 

I adopt a head-driven bottom up generation algorithm 
(Calder/etal, 1989; Shieber/etal-89; vanNoord-90) that 
takes advantage of lexical information as well as the top- 
down input provided by the planner. This approach is 
particularly useful for categorial grammars since most 
of the information is stored in the lexical entries rather 
than the grammar rules. 

The planning component described above provides 
the input for the algorithm, for example, to generate a 
sentence with the syntactic, semantic, and information 
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Figure 4: Input to the Generation Algorithm. 



structure features shown in Figure 4.^ The input does 
not have to fully specify the word order in the infor- 
mation structure. For instance, since the description 
in Figure 4 of the sentence to be generated does not 
specify the function of "the students" in the informa- 
tion structure, either of the following two word orders 
can be generated: 
(17) a. Ayse ogrencileri iicte gordii. 

Ayse student-Pl-Acc three-Loc see-Past. 

"Ayse saw the students at THREE." 
b. Ayse iicte gordii ogrencileri. 

Ayse three-Loc see-Past student-Pl-Acc. 

"Ayse saw the students at THREE." 
The algorithm for the head-driven bottom up gener- 
ator is seen below: 

generate (Input) :- 

find_lex_cat( Input ,LexDag) , 
bup_generate(Input ,LexDag) . 

bup_generate(Input ,LexDag) :- unify (Input ,LexDag) , 

bup_generat e( Input , LexDag) :- 

combine (Arg, LexDag, ResDag, backward), 
generate (Arg) , 
order(Arg, LexDag, ResDag), 
concat_phons(Arg, LexDag, ResDag), 
bup_generat e( Input , ResDag). 

bup_generat e( Input , LexDag) :- 

combine (LexDag, Arg, ResDag, forward), 
generate (Arg) , 
order(LexDag, Arg, ResDag), 



concat_phons (LexDag, Arg, ResDag), 
bup_generat e( Input , ResDag). 

This algorithm is very similar to the (Calder/etal, 
1989) algorithm for Unificational Categorial Grammar 
(UCG). First, the function generate finds a category 
in the lexicon which is the head of the sentence. Then in 
bup-generate, we try to apply the combinatory gram- 
mar rules (i.e. the forward and backward {}-CCG rules) 
to this lexical functor to generate its arguments in a 
bottom-up fashion. The order function applies the or- 
dering rules to the functor and argument to make sure 
that they form a constituent in the information struc- 
ture. The bup-generate function is called recursively 
on the result of applying the rules until it has found all 
of the head functor's (LexDag) arguments, eventually 
resulting in something which unifies with the Input}'''' 
The main difference between this CCG algorithm and 
the UCG algorithm is that the CCG algorithm uses all 
of the information (syntactic, semantic, and informa- 
tion structure features) given in the input, instead of 
using only the semantic information, to find the head 
functor in the lexicon. This is possible because of the 
formulation of the CCG rules. We can assume there is 
some function in the lexicon whose result unifies with 
the input, if this function is to take part in a CCG 
derivation that produces the input. This assumption 
is built into the CCG rules, since the head daughter in 
each rule (shown in bold in the following {}-CCG rules) 
shares its function result (X) with the final result after 
applying the rule: 

(18) a. X\{Y,...} Y ^X|{...} 

b. Y X|{Y,...} ^X|{...} 



^Note that the semantic predicates of the sentence are repre- 
sented using a hst notation; the DAG unification algorithm has 
been extended to recognize the function format such as student(x) 
as features. 



^'-'Note that order and concat-phons must be cahed after we 
have lexicahy instantiated both Arg and LexDag to avoid infinite 
loops. The UCG algorithm also freezes such features until the 
argument is instantiated. 



c. X\{Y,...A Y\{...2} ^X\{.. .,,... 2} 

d. Y|{...i} X|{Y,...J ^X\{.. .,,... 2} 

To make the algorithm more efficient, find-lex-cat 
first finds a rough match in the lexicon using term- 
unification. We associate each item in the lexicon with 
a semantic key-predicate that is one of the properties 
in its semantic description. A lexical entry roughly 
matches the input if its semantic key-predicate is a 
member of the list of semantic properties given in the in- 
put. After a rough match using term-unification, find- 
lex-cat unifies the DAGs containing all of the known 
syntactic, semantic, and pragmatic information for the 
most embedded result of the lexical category and the 
result of the input, e.g. Figure 4, to find the lexical 
category which is the head functor. ^^ Then, the rules 
can be applied in a bottom up fashion assuming that 
the found lexical category is the head daughter in the 
rules. 

In this section, I have shown how the head-driven 
bottom-up generation algorithm can be adapted for 
the CCG formalism. The following sample runs of the 
generation system further demonstrate how context- 
appropriate word orders are generated in this formal- 
ism. 

4.2 Sample Runs 

The sample runs below represent the following trans- 
lated dialogue: 

(19) a. Fatma Ayse'yi gorebilirmi? 

Fatma Ayse-Acc see-abil-aor-quest? 
"Can Fatma see Ayse?" 
b. Evet, Fatma Ayse'yi ikide gorebilir. 
Yes, Fatma Ayse-Acc two-Loc see-abil-aor. 
"Yes, Fatma can see Ayse at TWO." 

(20) a. Ikide kimi gorecek Fatma? 

Two-Loc who-Acc see-Future Fatma? 
"Who will Fatma see at two?" 
b. Ikide Ayse'yi gorecek Fatma. 

Two-loc Ayse-Acc see-Pres-prog Fatma. 
"At two, she, Fatma, will see AY§E." 

The questions are the user's input and the answers are 
the Personal Assistant system's replies. Each question- 
answer pair is followed by the DAG representation of 
the answer. Note that the syntax and semantics of the 
answers in each run are identical, but the difference in 
their information structure is refiected in the word order 
that is generated. 



I : fatma ayseyi gorebilirmi? 

Answer: evet, fatma ayseyi ikide gorebilir. 

Dag: 
syn : 

cat : s 

voice : active 
tense : aorist 
agr : 

number : sing 
person : 3 
compound : abilitive 
sem : 

type : decl 

If : [time(e6,2), see(e6, fatma, ayse) , 
[one(fatma) ,def (fatma, +)] , 
[one(ayse) ,def (ayse,+)]] 
event : e6 
info : 

rheme : 

focus : [time(e6,2)] 
mainprop : see(e6, fatma, ayse) 
theme : 

topic : [one(fatma), def (fatma, +)] 
neutral : [one(ayse), def (ayse, +)] 
background : none 



The function hnd-lex-cat can also hnd type-raised NPs in the 
lexicon whose results unify with the input. To prevent infinite 
loops, I represent the semantic features of the NP in the result of 
the type-raised function, rather than having a variable v as the 
result in v/[v\np). 



I : ikide kimi gorecek fatma? 
Answer: ikide ayseyi gorecek fatma. 
Dag: 
syn : 

cat : s 

voice : active 
tense : future 
agr : 

number : sing 
person : 3 
sem : 

type : decl 

If : [time(e6,2), see(e6, fatma, ayse) , 
[one(fatma) , def (fatma, +)] , 
[one(ayse) , def (ayse, +)]] 
event : e6 
info : 

rheme : 

focus : [one(ayse) , def (ayse, +)] 
mainprop : see(e6, fatma, ayse) 
theme : 

topic : [time(e6,2)] 
neutral : none 
background : [one(f atma) , def (fatma, +)] 



5 Conclusions 

In this paper, I have presented a strategy for the re- 
alization component of a generation system to handle 
word order variation in Turkish sentences. I integrated 
a level of information structure with a unification-based 
version of Combinatory Categorial Grammars, adapted 
for free word order languages. I discussed an imple- 
mentation of a database query task using a modified 
head-driven bottom-up generation algorithm to demon- 
strate how the categorial formalism generates Turkish 
sentences with word orders appropriate to the context. 
Further research is needed on processing the infor- 
mation found in the information structure after pars- 
ing a sentence, e.g. inferences about how focused dis- 
course entities or topic entities are related to sets of 
other discourse entities in the discourse model. In ad- 
dition, a separate algorithm, perhaps Centering Theory 
(Grosz/etal-83), is needed to keep track of the salience 
of discourse entities and resolve the reference of empty 
pronouns, or in the case of generation, to determine 
what must be realized and what can be dropped in the 
utterance. In future research, I would also like to ex- 
tend this same approach to generate certain stylistic 
constructions in English such as topicalization, it-clefts, 
and right dislocation. 
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